Depth-3 Arithmetic Circuits for S'^{X) and 
_ Extensions of the Graham-Pollack Theorem 
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Abstract 

We consider the problem of computing the second elementary symmetric poly- 
nomial S'^{X) = '}2ii<i<j<n'^i'^i using depth-three arithmetic circuits of the form 
Si=i rijLi where each Lij is a linear form in Xi, . . . , X„. We consider this 

c/3 , problem over several fields and determine exactly the number of multiplication gates 

required. The lower bounds are proved for inhomogeneous circuits where the Lj^'s are 
allowed to have constants; the upper bounds are proved in the homogeneous model. 
For reals and rationals, the number of multiplication gates required is exactly n — 1; 
in most other cases, it is |"^] . 
' This problem is related to the Graham-Pollack theorem in algebraic graph theory. 

f-*) . In particular, our results answer the following question of Babai and Frankl: what 

is the minimum number of complete bipartite graphs required to cover each edge of 
a complete graph an odd number of times? We show that for infinitely many n, the 
answer is TSl . 

O 

, J . 1 Introduction 

X 

5^ ! 1.1 The Graham-Pollack theorem 

Let Kn denote the complete graph on n vertices. By a decomposition of Kn, we mean a 
set {Gi, G2, . . . , Gr} of subgraphs of Kn such that 

1. Each Gi is a complete bipartite graph (on some subset of the vertex set of Kn)', and 

2. Each edge of Kn appears in precisely one of the Gj's. 
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It is easy to see that there is such a decomposition of the complete graph with n — 1 
complete bipartite graphs. Graham and Pollack ||GP72|| showed that this is tight. 

Theorem If {Gi,G2, ■ ■ ■ ,Gr} is a decomposition of Kn, then r > n — 1. 

The original proof of this theorem, and other proofs discovered since then [|dCH89| , pec84 



Tve82|| , used algebraic reasoning in one form or another; no combinatorial proof of this 
fact is known. 

One of the goals of this paper is to obtain extensions of this theorem. To better 
motivate the problems we study, we first present a proof of this theorem. This will also help 
us explain how algebraic reasoning enters the picture. Consider polynomials in variables 
X = Xi, X2, . . . , Xn with rational coefficients. Let 

l<i<j<n 
n 

i=l 

Then, we can reformulate the question as follows. What is the smallest r for which there 
exist sets Lj, Ri C [n], Lj fl = 0, for z = 1, 2, . . . , r, such that 

r 

Notice that the two sums in the product on the right are homogeneous linear forms i.e. 
linear forms in Xi, . . . ,Xn with constant term 0. One may generalise this question, and 
ask: What is the smallest r for which there exist homogeneous linear forms Li{X),Ri{X) 
for i = 1,2 ... ,r, such that 

r 

Sl{X) = Y,L.iX)R.iX) (2) 

j=i 



Tverberg [p?ve82|] gave the following elegant argument to show that r must be at least 
n-1. Observe that T^{X) = (Er=i^*)^ - 252(X). Thus, (§ implies 

n r 

n{x) = {j2x,r-2Y,Hx)R,{x) (3) 

1=1 i=l 

Now if r is less than n — 1, then there exists a non-zero a = [ai, a2, . . . , a;„) G Q"" such 
that Li{a) = for i = 1, 2 . . . , r and ^"^j^ = (because at most n — 1 homogeneous 
equations in n variables always have a non-zero solution). Under this assignment to the 
variables, the right hand side of is zero but the left hand side is not. 

With this introduction to the Graham-Pollack theorem and its proof, we are now ready 
to state the questions we consider in this paper. Observe that the lower bound for r in (Q) 
depended crucially on the field being Q, and there are two main difficulties in generalising 
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it to other fields. First, over fields of characteristic two, the relationship between S^{X) 
and T^{X) does not hold, for we cannot divide by 2. Second, even if we are not working 
over fields of characteristic two, T^{X) can vanish at some non-zero points. Equations 
similar to (H) have been studied in the past in at least two different contexts viz. covering 
a complete graph by complete bipartite graphs such that each edge is covered an odd 
number of times (the odd cover problem), and depth-3 arithmetic circuits for S^{X). 



1.2 The odd cover problem 

Suppose in the Graham-Pollack problem, we drop the condition that the bipartite graphs 
be edge-disjoint, but instead ask for each edge of the complete graph to be covered an odd 
number of times. We call this problem the odd cover problem. How many bipartite graphs 
are required in such a cover? This question was posed by Babai and Frankl [PF92|| , who 
also observed a lower bound of [|J . However, the upper bound was the trivial n — 1. Note 
that this problem is equivalent to considering ([l|) over the field GF(2). 



1.3 SnS arithmetic circuits 

By a SHS arithmetic circuit over a field F, we mean an expression of the form 



(4) 



i=i j=i 



where each Lij{X) is a (possibly inhomogeneous) linear form in variables Xi, . . . , X„. The 
above expression is to be treated as over the field F. Such 'depth-three' circuits play 
an important role in the study of arithmetic complexity ||NW96| , |GRO0| , |SW99|| . If each 
linear form Lij{X) is homogeneous (i.e. has constant term zero), the circuit is said to 
be homogeneous, or else, it is said to be inhomogeneous. Although depth-three circuits 
appear to be rather restrictive, these are the strongest model of circuits for which super 
polynomial lower bounds for computing explicit polynomials are known; no such lower 
bounds are known at present for depth-four circuits. 

The k-th elementary symmetric polynomial on n variables is defined as follows. 



re 



Elementary symmetric polynomials are the most commonly studied candidates for 
showing lower bounds in arithmetic circuits. Nisan and Wigderson ||NW96 | showed that 
any homogeneous SHS circuit for computing S'^'^(X) has size f2((n/4/c)^). In their paper, 
they explicitly stated the method of partial derivatives (but see also Alon [|Alo86|| ). Al- 
though a super polynomial lower-bound was obtained in ||M W96|| , the lower bound applied 
only to homogeneous circuits. Indeed, Ben-Or (see e.g. ||NW96|| ) showed that any elemen- 
tary symmetric polynomial can be computed by an inhomogeneous SHE formula of size 
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O(n^). Thus, inhomogeneous circuits are significantly more powerful than homogeneous 
circuits. Shpilka and Wigderson |pW99|| (and later, Shpilka ||Shp01|| ) addressed this short- 
coming of the Nisan- Wigderson result and showed an Q{n'^) lower bound on the size of 
inhomogeneous SIIS formulae computing certain elementary symmetric polynomials, thus 
showing that Ben-Or's construction is optimal. To obtain their results, they augmented 
the method of partial derivatives by an analysis of (affine) subspaces where elementary 
symmetric polynomials vanish. Many of the lower bounds in this paper are inspired by the 
insights from [|SW99| | and |[Shp01 |. All the results cited above work over fields of charac- 



teristic zero. At present, no super-quadratic lower bounds are known for computing some 
explicitly defined polynomial in the inhomogeneous SHE model over infinite fields. Over 
finite fields the situation is better. Karpinski and Grigoriev ||GK98|| showed an exponen- 
tial lower bound for computing the determinant polynomial using (inhomogeneous) SHE 
circuits over any finite field. Grigoriev and Razborov [ GROO | showed an exponential lower 
bound for any (inhomogeneous) EIIE circuit computing a generalised majority function 
over any finite field. 

Though the elementary symmetric polynomials have been studied with reasonable suc- 
cess in the past in the SHE model of computation, the upper and lower bounds obtained 
till now agree at best to within constant multiplicative factors. In this paper, we study 
the simplest non-trivial elementary symmetric polynomial, viz. S^{X), in various flavours 
of the Ens model. This does not make the problem trivial; in fact, some of these flavours 
have implications to interesting combinatorial problems like, for example, the odd cover 
problem mentioned above. Instead of upper and lower bounds to within constant multi- 
plicative factors, we shall be interested in the exact answer, in the spirit of Graham and 
Pollack. In all the cases we study, we obtain exact answers for infinitely many n, and in 
some cases, for all n. One of the implications of this work is an exact bound of [|] for 
infinitely many even and odd n for the odd cover problem. 



Organisation of this paper 

In the next section, we give a summary of our results. In Section ^, we present formal 
proofs of our upper bound results. Section ^ contains formal proofs of our lower bound 
results. The appendix contains statements of our results and their proofs, for computing 
S^{X) using EIIE arithmetic circuits over the fields GF(p''), p an odd prime. 



2 Our results 

We study the computation of the elementary symmetric polynomial S^{X) using SIIS 
arithmetic circuits over several fields, with the aim of obtaining exact bounds on the 
number of multiplication gates required. Many of the techniques developed earlier (in 
particular, the method of partial derivatives), in fact, give lower bounds on the number of 
multiplication gates. Also, counting the number of multiplication gates only, allows us to 
give bounds for the odd cover problem and the 1 mod p cover problem, p an odd prime 
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(generalisation of the Graham-Pollack problem where we now require that each edge be 
covered 1 mod p times). 

As described in the introduction, computations of elementary symmetric polynomials 
have been considered for several flavours of SIIS circuits. For the polynomial S'^(X), we 
study three different flavours of the SIIS model. 

1. The graph model: This is the weakest model. Here, the linear forms Li{X) and Ri{X) 
(see equation (||) above) must correspond to bipartite graphs; that is, all coefficients 
must be 1 (or 0), no variable can appear in both Li and Ri (with coefficient 1), and 
no constant term is allowed in these linear forms. This is the setting for the Graham- 
Pollack theorem and its generalisations viz. the odd cover problem and the 1 mod p 
cover problem [p an odd prime). 

2. The homogeneous model: Here the linear forms are required to be homogeneous, that 
is, no constant term is allowed in them. However, any element from the field is 
allowed as a coefficient in the linear forms. This model was studied by Nisan and 
Wigderson [|NW96|] , using the method of partial derivatives. 



3. The inhomogeneous model: This is the most general model; there is no restriction on 
the coefficients or the constant term. 

We show our upper bounds in the graph and the homogeneous model; our lower bounds 
hold even in the stronger inhomogeneous model. We juxtapose our results against the 
previously known results and also briefly mention the proof technique used, highlighting 
our contribution. Note that the previous lower bounds were for the homogeneous circuit 
model only, and were proved using the method of partial derivatives ||NW96|| (but see also 



the rank arguments of Babai and Frankl |PF92|| for the graph model). Below, the notation 



3°°n means '/or infinitely many n ' and the notation Vn means 'for all n '. 



2.1 The odd cover problem and computing S^{X) over GF(2) 



Bounds: 
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Proof Methods. For the upper bound in the graph model, we restrict our attention to a 
class of schemes, which we call pairs constructions, for constructing odd covers of Kn ■ We 
relate the pairs construction to the existence of certain kinds of good matrices. We then give 
two different constructions of good matrices. The first construction is based on conference 
matrices, which are related to Hadamard matrices. The second construction is based on 
symmetric designs, and uses some elementary properties about quadratic residues. The 
first construction gives optimal odd covers for infinitely many n of the form mod 4; the 
second gives optimal odd covers for infinitely many n of the form 2 mod 4. We get [l] 
sized odd covers for infinitely many n of the forms n = 1,3 mod 4 from odd covers of Kn+i 
of optimal size. 

The [|J upper bound in the homogeneous model for n = 1 mod 4 is got by locally 
transforming a homogeneous circuit computing 5'^_^(X) using multiplication gates to 
a homogeneous circuit computing S^{X) using the same number of multiplication gates. 

For the lower bound, we use the method of substitution used by Shpilka and Wigder- 
son ||SW99|| , and subsequently refined by Shpilka |^hp01| , 



However, the proof is not a 



straightforward application of earlier methods. Technical difficulties arise because we are 
working over GF(2) and not over fields of characteristic zero. Almost all the earlier lower 
bound proofs used partial derivatives in some way or the other. Over GF(2), most of these 
approaches fail to work. Thus, we have to exploit the method of substitution in ways which 
do not use partial derivatives. 

In fact, we place the method of substitution in a general framework and recast it to 
obtain a family of equations. We then exploit the family of equations depending upon the 
field in question, to obtain different lower bounds for different fields. 



2.2 1 modp cover problem, p an odd prime 
Bounds: 





Our Bounds 


Previous Bounds 
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Proof Methods. The upper bound follows by a pairs construction argument (refer Sec- 
tion We reduce the problem of existence of a pairs construction to the existence of 
certain kinds of matrices good for p. By a modification of the symmetric designs construc- 
tion (refer Section |2.1| ) , we construct an infinite family of matrices good for p. This suffices 
to show the upper bounds for the 1 mod p cover problem. We use the same lower bounds 
as those known earlier for homogeneous circuits. 
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2.3 Computing Sl{X) over C 
Bounds: 
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Proof Methods. For the upper bound, we reformulate the algebraic problem and arrive 
at a suitable bilinear form. Then, if the notion of "distance" between vectors is defined 
using this bilinear form, the problem reduces to finding suitably spaced vectors with com- 
plex coordinates. We then show the existence of such a suitably spaced family of vectors. 
The proof has a geometric fiavour. For the lower bound, we now use the general framework 
mentioned in Section |2.1| . This time however, the way we exploit the family of equations is 
very different; in particular, we view the constraints geometrically and arrive at a (differ- 
ent) bilinear form. Then, if the notion of "distance" between vectors is defined using this 
bilinear form, the problem reduces to placing a certain number of points on a sphere of a 
certain radius such that all the points are equidistant with a certain common distance. We 
then show that such a placement of points is impossible. 

2.4 Computing Sl{X) over M and Q 
Bounds: 
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Graph 


ounds 
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Proof Methods. In this case, we show that the trivial upper bound of — 1 is tight 
even for inhomogeneous circuits. The proof of the Graham-Pollack theorem works only for 
homogeneous circuits. To extend the result to inhomogeneous circuits, we need to use the 
method of substitution. The result is relatively straightforward once the problem is placed 
in this framework. We state the result for completeness. 

3 Upper bounds 
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3.1 The odd cover problem and computing S^{X) over GF(2) 

In this section, we will show that there is an odd cover of i^2n by n complete bipartite 
graphs whenever there exists a n x n matrix satisfying certain properties. We describe a 
particular scheme for producing an odd cover of K2n, which we call a pairs construction. 
Wc express the requirements for a pairs construction in the language of matrices, and then 
give sufficient conditions for a matrix to encode a pairs construction. We call a matrix 
satisfying these sufficient conditions a good matrix. 

We want to cover the edges of with n complete bipartite graphs such that each 
edge is covered an odd number of times. A complete bipartite graph is fully described 
by specifying its two colour classes A and B. Partition the vertex set [2n] (of K2n) into 
ordered pairs (1, 2), (3, 4), . . . , (2n — l,2n). In a pairs construction of an odd cover of 
K2n, if one element of a pair does not participate in a complete bipartite graph G in the 
odd cover decomposition, then the other element of the pair does not participate in G 
either, and also, both the elements of a pair do not appear in the same colour class in G. 
Hence, to describe a complete bipartite graph G in a pairs construction of an odd cover 
decomposition, it suffices to specify for each pair (2i — 1, 2i), whether the pair participates 
in the bipartite graph, and when it does, whether 2i appears in colour class A or B. We 
specify the n complete bipartite graphs in the odd cover decomposition by a n x n matrix 
M with entries in {—1, 0, 1}. The rows of the matrix are indexed by pairs; the ith row is 
for the pair {2i — 1, 2i). The columns are indexed by the complete bipartite graphs of the 
odd cover decomposition. If M^j = 0, the pair (2i — 1, 2i) does not participate in the jth 
bipartite graph Gj] if Mj^ = 1, 2i appears in colour class B of Gj] if Mj^ = —1, 2i appears 
in colour class A of Gj. 
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The matrix M describes a pairs construction of an odd cover of Kg, by complete bipartite 

graphs ^1,^2,^3,^4. 

Figure 1: An example of a pairs construction. 
We now identify properties of the matrix M which ensure that the complete bipartite 
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graphs arising from it form an odd cover of K2n- 

Definition 1 Anxn matrix with entries from { — 1, 0, 1} is good if it satisfies the following 
conditions: 

1. In every row, the number of non-zero entries is odd. 

2. For every pair of distinct rows, the number of columns where they both have non-zero 
entries is congruent to 2 mod 4. 

3. Any two distinct rows are orthogonal over the integers. 

Lemma 1 If an n x n matrix is good, then the n complete bipartite graphs that arise from 
it form an odd cover of K2n- 

Proof: Since the number of non-zero entries in a row is odd, the number of times the 
corresponding edge {2i — 1, 2i} is covered is odd. Next, consider edges whose vertices come 
from different pairs: say, the edge {1,3}. We need to show that the number of bipartite 
graphs where 1 and 3 are placed on opposite sides is odd. Consider the rows of the matrix 
corresponding to pairs (1,2) and (3,4). Since these rows are orthogonal over the integers, 
the number of times 1 appears on the opposite side of 3 must be equal to the number 
of times 1 appears on the opposite side of 4. Since the number of columns where both 
rows have non-zero entries is congruent to 2 mod 4, the number of times 1 appears on the 
opposite side of 3 (as well as the number of times 1 appears on the opposite side of 4) must 
be odd. Thus, given a good matrix, we can construct n complete bipartite graphs covering 
each edge of an odd number of times. ■ 
Thus, to obtain odd covers, it is enough to construct good matrices. We now give two 
methods for constructing such matrices. 

Construction 1: Skew symmetric conference matrices 

A Hadamard matrix H„ is an n x n matrix with entries in {—1,1} such that H„H^ = 
nlni where is the n x n identity matrix. A conference matrix C„ is an x n matrix, with 
O's on the diagonal and —1, +1 elsewhere, such that C„C^ = {n — 1)1^. The following fact 
can be verified easily. 

Lemma 2 n x n conference matrices, where n = mod 4, are good matrices. 

Skew symmetric conference matrices can be obtained from skew Hadamard matrices. A 
skew Hadamard matrix is defined as a Hadamard matrix that one gets by adding the 
identity matrix to a skew symmetric conference matrix. Several constructions of skew 
Hadamard matrices can be found in ||Hal86| , p. 247]. In particular, the following theorem 
is proved there. 

Theorem 1 There is a skew Hadamard matrix of order n if n = 2^ki ■ ■ ■ kg, where n = 
mod 4, each ki = mod 4 and each ki is of the form p^ + 1, p an odd prime. 
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Corollary 1 There is a good matrix of order n if n satisfies the conditions in the above 
theorem. Note that the conditions hold for infinitely many n. 



As an illustrative example, we show the existence of skew Hadamard matrices F„ when n 
is a power of 2. To do this, we modify the well-known recursive construction for Hadamard 
matrices. For = 2, set (F2)2i = —1 and the rest of the entries 1. Suppose now that we 
have constructed F„. To construct F2n, place a copy of F^ in the top left corner, a copy of 
— F„ in the bottom left corner, and copies of F^ in the top right and bottom right corners. 
It is easy to check that F2n so constructed is skew Hadamard. In fact, the matrix M in 
Figure |l| is nothing but F4 — I4. 
Construction 2: Symmetric designs 

The matrices M that we now construct are based on a well-known construction for 
symmetric designs. These matrices are not conference matrices; in fact, they have more 
than one zero in every row. 

Let g be a prime power congruent to 3 mod 4. Let F = GF(g) be the finite field of q 
elements. Index the rows of M with lines and the columns with points of the projective 
2-space over F. That is, the projective points and lines are the one dimensional and two 
dimensional subspaces respectively, of F^. A projective point is represented by a vector in 
F'^ (out of g — 1 possible representatives) in the one dimensional subspace corresponding 
to it. A projective hne is also represented by a vector in F^ (out of g — 1 possible repre- 
sentatives). The representative for a projective line can be thought of as a 'normal vector' 
to the two dimensional subspace corresponding to it. We associate with each projective 
line L a linear form on the vector space F^, given by L{w) = v'^w, where w E ¥^ and v 
is the chosen representative for L. For a projective line L and a projective point Q, let 
L{Q) = L{w), where w is the chosen representative for Q. Now the matrix M is defined 
as follows. If L{Q) = (i.e. projective point Q lies on projective line L), we set M^^q = 0; 
if L{Q) is a (non-zero) square in F, set q = 1; otherwise, set q = —1. 

We now check that M is a good matrix. M is a n x n matrix, where n = g^ + g + l, ga 
prime power congruent to 3 mod 4. The number of non-zero entries per row is g^ + g + 1 — 
(g + 1) = g^, which is odd. The number of columns where two distinct rows have non-zero 
entries is g^ + g + 1 — 2(g -|- 1) -|- 1 = g^ — g. This number is 2 mod 4 since g = 3 mod 4. 
Recall that in the projective 2-space over GF(g), each line contains g + 1 points, and two 
distinct lines intersect in a single point. Now we only need to check that any two distinct 
rows (corresponding to distinct projective lines L, V) are orthogonal over the integers. We 
first observe that the following equality holds over the integers. 



Y,ri{L{P)UL\P)) 



1 



- viLivML'iv)) 



(5) 



p 



q - 



?;^{0,0,0) 
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if X is a (non-zero) square . 
if X is not a square 
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[The first sum is over all points P of the projective 2-space. The second is over all non-zero 
triples V in F^.] The equality holds because if we take two non-zero triples u and w = au 
(a 7^ 0) corresponding to the same projective point, then 

rj{L{w))rj{L' {w)) = rj{L{au))rj{L' [au]) 

= rj{aL{u))rj{aL' {u)) 

= v{(^)v{L{u))r]{a)r]{L'{u)) 

= r^{L{u)ML'{u)) 

Now consider the sum on the right hand side of (^). We have 

ri{L{v)HL'{v)) = Yl E ^(«)^(^) 

1)7^(0,0.0) a,b&;a,bj^O v:L(v)^a.L' (v)^b 

1)7^(0,0,0) 

The linear forms corresponding to two distinct projective lines are linearly independent; 
i.e., L and V are linearly independent. Hence, for every pair (a, h) in the sum above, there 
are exactly q triples v such that L{y) = a and L'{v) = b. Thus, 

Y v{L{'v))ri{L'{v)) = q- Y vi^Mb) 

1)7^(0,0,0) a,be¥; a,by^O 

= q- Y V{ab) 

a,6eF; a,bj^O 

= - 1) ■ Y 

c6F; C7^0 

= 

The last equality holds because there are exactly [q — l)/2 squares and the same number 
of non-squares in F — {0}. We conclude that the left hand side of is 0; hence, the rows 
corresponding to distinct projective lines are orthogonal over the integers. 
We have thus proved the following lemma. 

Lemma 3 If q = 3 mod 4 is a prime power then there is a good matrix of order + g + 1 . 
Note that infinitely many such q exist. 

We can now easily prove the following theorem and its corollary. 

Theorem 2 For infinitely many n = 0,2 mod 4 we have an odd cover of Kn using ^ 
complete bipartite graphs. 

Proof: We use f x | good matrices to construct an odd cover of Kn using | complete 
bipartite graphs(see Lemma [^). For infinitely many n = mod 4, we can use the good 
matrices of Corollary 0. For infinitely many n = 2 mod 4, we can use the good matrices of 
Lemma ^ ■ 
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Corollary 2 For infinitely many n = 1, 3 mod 4 we have an odd cover of Kn using [l] 
complete bipartite graphs. 

Proof: For odd n, any odd cover of Kn+i using complete bipartite graphs gives us an 
odd cover for Kn too. The corollary now follows from the above theorem. ■ 
We also prove the following lemma, which allows us to construct homogeneous SIIS 
circuits for S^iX) with [^J multiplication gates, for infinitely many n = 1 mod 4. 

Lemma 4 If Sn{X),n = mod 4, can be computed over GF{2) by a homogeneous SIIS 
circuit using ^ multiplication gates, then Sn+i{X) can be computed over GF(2) by a ho- 
mogeneous Ens circuit using ^ multiplication gates. 

Proof: Consider a homogeneous circuit over GF(2) 

r 

''^^ Li{Xi, . . . , Xn)Ri{Xi, . . . , Xn) (6) 
i=l 

for S^iXi, . . . , Xn), n = mod 4, where r = ^. Define for 1 < i < r, homogeneous linear 
forms L[{Xi, . . . , Xn+i), R'^^Xi, . . . , over GF(2) as follows. 

L'j(Xi, . . . , Xn+i) = Li{Xi, . . . , Xn) + Xn+i if Li has an odd number of terms 

= Li{Xi, . . . , Xn) otherwise 

R'^{Xi, . . . , Xn+i) = Ri{Xi, . . . , Xn) + Xn+i if -Rj has an odd number of terms 

= Ri{Xi, . . . , Xn) otherwise 

We have the following equality over GF(2). 
Claim 

r 

'S'n+l(-^l) ■ ■ ■ ) Xn+l) = ^ L'-{Xi, . . . , Xn+l)R'i{Xi, . . . , X„+i) 

i=l 

Proof: Define homogeneous linear forms over Z, L"{Xi, . . . , Xn+i), R'-{Xi, . . . , Xn+i), for 
1 < i < r, as follows. 

^ii-^ly • • • 5 Xn+l) = Li{Xi, . . . , Xn) + aiXn+l 
R'ii^li ■ ■ ■ 1 -^n+l) = Ri{Xl., . . . , Xn) + biXn+l 

where a,, 6, denote the number of (non-zero) terms in Li,Ri respectively. Consider the 
following formula over Z. 

r 

L'l{Xi, . . . , X„+i)_R-'(Xi, . . . , Xn+i) (7) 

i=l 

Let Cjk,l < j < k < n denote the coefficient of XjX^ in (|^), treating as a formula 
over Z instead of over GF(2). Since formula computes Sn{X) over GF(2), Cjk,l < 
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j < k < n are odd, and Cjj, I < j < n are even. Let c")^,! < j < k < n + 1 denote the 
coefficient of XjX^ in (note that cj^ is an integer). For I < j < k < n, c'^f^ = Cjk- We 
will now show that c'j^^+i^ 1 < j < are odd, and c'^+i^n+i is even. This suffices to prove 
the claim, since L" = L[ mod 2 and R" = R[ mod 2. 
For any 1 < j < n, it can be easily checked that 

Cj,n+1 — 5^ Cjfc + 2Cjj 

k:\<k<n 

= ^1 + (mod 2) 

fc:l<fc<n 

= 1 (mod 2) 

The last equivalence follows from the fact that, for any fixed j, the number of monomials 
XjXk, l<k<n,k^jis odd, since n is even. 

^<j<k<n 



l<j<k<n l<i<" 



\l<j<k<n l<j<n / 

= (mod 2) 

The last equivalence follows from the fact that the number of monomials XjXk, 1 < J < 

k < n is even, since n = mod 4. 

Hence the claim is proved. ■ 
The lemma now follows from the above claim. ■ 
We can now prove the following theorem. 

Theorem 3 For infinitely many n = 0, 2, 3 mod 4 we have homogeneous SHE circuits 
computing S^{X) over GF{2) using j"^] multiplication gates. For infinitely many n = 
1 mod 4 we can compute S^{X) over GF{2) using homogeneous SIIS circuits having [|J 
multiplication gates. 

Proof: The ffist part of the theorem follows from Theorem ^ and Corollary |^. To prove 
the second part, consider a homogeneous circuit for ^^.^(Xi, . . . , n = 1 mod 4, 

using r = multiplication gates. Such circuits exist for infinitely many n = 1 mod 4 by 
the ffist part of the theorem. We now invoke Lemma ^ to complete the proof. ■ 



3.2 1 modp cover problem, p an odd prime 

In this subsection we will in fact show, for any odd number p (not necessarily prime), that 
there is a 1 mod p cover of by n complete bipartite graphs whenever there exists an 
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n X n matrix good for p (defined below). Also, from a 1 mod p cover of K2n+2 by n + 1 
bipartite graphs, we get a 1 mod p cover of i^2n+i by n + 1 bipartite graphs. We note 



that the skew Hadamard matrix construction of Section |3.1| does not generalise to give us 
matrices good for p, when p is odd. 

Definition 2 Let p be an odd number. A matrix with entries from { — 1,0,1} is called a 
good matrix for p if it satisfies the following conditions: 

1. In every row, the number of non-zero entries is 1 mod p. 

2. For every pair of distinct rows, the number of columns where they both have non-zero 
entries is congruent to 2 mod 2p. 

3. Any two distinct rows are orthogonal over the integers. 

Lemma 5 Let p be an odd number. If an n x n matrix is good for p, then the n complete 
bipartite graphs that arise from it form a 1 mod p cover of K2n- If n = + q + 1 where q 
is a prime power and g = — 1 mod 2p, then an n x n good matrix for p exists. Note that 
infinitely many such q exist, by a result of Dirichlet. 

Proof: The proof of the fact that an n x n good matrix for p gives us a 1 mod p cover of 
by n complete bipartite graphs, is similar to the proof of Lemma ^ The construction 
of an n X n good matrix for p when n is of the given form is similar to the symmetric 



designs construction of Section 3.1 



From the lemma, we can now prove the following theorem. 

Theorem 4 Given an odd number p, for infinitely many odd and even n, we have a 
1 mod p cover of Kn using ["l] bipartite graphs. 

3.3 Fields of characteristic different from 2 

Now we give the proofs for the upper bounds in the homogeneous circuit model for com- 
puting S^{X) over various fields of characteristic different from 2. We start by proving two 
lemmas. 

Lemma 6 S2i^^i{Xi, . . . , X2k+i) can be computed by a homogeneous SIIS circuit using 
k -\- 1 multiplication gates over any field of characteristic not equal to 2 which has square 
roots of —1. 



Proof: This result has been observed implicitly by Shpilka [ ShpOl ]. We give a proof here 
for completeness. Let i denote a square root of —1. 

^ 2k+l 2k+l 
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^ 2fc+l 2k+l 

2fc+l 2fc+l fc 

2 



X,)(2X, + 5^ X,) - ^(XJ. + X,%,)) 

j=2 j=2 j=l 

^ 2k+l 2k+l k 

-((5^ X,)(2Xi + X,) - $^(X2, + ^X2,+i)(X2, - ^X2,+i)) 



2 

i=2 j=2 j=l 

This shows that S'|;,_|_]^(Xi, . . . , X2fc+i) can be done with k + 1 muhiphcation gates. ■ 

Lemma 7 S'|^(Xi, . . . ,X2fc) can 6e computed by a homogeneous EIIS circuit using k mul- 
tiplication gates over any field F of characteristic not equal to 2 which has square roots of 
-1, 2 and 2k - 1. 

Proof: Let am(Xi, . . . , X2k) and bm{Xi, . . . , X2k) denote the two homogeneous hnear forms 
feeding into the mth muhiphcation gate, 1 < m < k. Let 

am{Xi, . . . , X2k) = Zlntl (^mnXmn 1 1 < m < k 

bm{Xi, . . . , X2k) = X]n=l ^mn-^mn J 

Since the circuit computes S'|^,(Xi, . . . , X2k), equating the coefficients of X|, 1 < j < 2k 
we get 

k 

ami&mi = l< i <2k 

m=l 

Since the characteristic is not equal to 2, we can get an equivalent equation by multiplying 
both sides by 2. 

k 

'^{amjbmj + amjbmj) = 1 < j < 2fc (8) 
m=l 

Equating the coefficients of X^X^, 1 < j < / < 2A; we get 

k 

"Yiamjbrni + amlbmj) = 1 I < j < I < 2k (9) 

m=l 

Let us define vectors yj G F^'^, 1 < j < 2A; as follows 

Vj = (c^ij, bij, a2j, b2j, . . . , ttkj, bkj) 
We can write (|^) in a succinct matrix form as 

yjAy, = l<j<2fc 



l/fA|/; = 1 l<j<l<2k 
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(10) 



where the 2k x 2k matrix A consists of k blocks of the 2x2 matrix 



V 1 

arranged along the diagonal. M has two eigenvalues 1 and —1, with corresponding eigen- 
vectors uj = (1,1) and u'^i = (1,-1) (note that 1 7^ —1 in F). It will be convenient 
to scale these vectors to obtain alternate eigenvectors vf = -^(1, 1) and v'^^ = -^{i, —i), 
where i denotes a square root of —1 in F (note that 2 7^ in F and 2 and —1 have square 
roots in F). Now, 

vjMvi = f^iMf.i = 1 
v^Mv.i = 

The 2x2 matrix 

N 



is the change of basis matrix for going from the basis {vi, f-i} of F^ to the standard basis 
{(1,0)"^, (0, 1)"^} of F^. We define another 2k x 2k matrix B, which consists of k blocks 
of the 2x2 matrix arranged along the diagonal. B is a change of basis matrix from a 
basis of F^'^ consisting of eigenvectors of A, to the standard basis of F^'^. If zj, 1 < j < 2fc 
are the representations of the vectors yj,l < j < 2k in the eigenbasis of A, then 

yj = Bzj 1 < J < 2/c 

Since 



B^AB = I 



2k 



where l2k is the 2k x 2k identity matrix, ([T0|) now becomes 



zjzj = l<j<2k 
zjzi = 1 l<3<l<2k 

We can write a set of equations equivalent to the above as follows (since 2 7^ in F) 

zjz, =0 l<j<2k , 

(z,-zif{z,-zi) = -2 l<j<l<2k ' 

The second equation above can be thought as finding vectors Zj G F^'^, 1 < j < 2k such 
that the "distance" between any two of them is a/^. The following set of vectors meets 
this requirement 

z'j = icj I < j < 2k 

where Cj, 1 < j < 2k are the standard basis vectors in W"^^. We now have to ensure that the 
"length" of each vector is 0. For this shift the origin to a point p = {w, w, . . . ,w), where w 
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will be determined later. Note that this operation does not change the "distance" between 
any pair of vectors. To determine w we have to solve the following equation 

(i-wf + {2k-l)w^ = 

which can be solved whenever 2k — 1 has a square root in the field. We now define 

Zj = z'j — p 1 < j <2k 

The vectors Zj,l < j < 2k are a solution to which in turn implies a solution to ( p!OD 
which proves the existence of a homogeneous circuit for the polynomial 5*1;, (Xi, . . . ,X2k) 
using k multiplication gates. ■ 
Using Lemmas |^ and we can now prove our upper bound result for complex numbers. 
The proofs of our upper bounds for GF{p^), p an odd prime can be found in the appendix. 

Theorem 5 S^{Xi, . . . , Xn) can be computed by a homogeneous SIIS circuit using f^] 
multiplication gates over the field of complex numbers. 

Proof: Follows directly from Lemmas ^ and ^ ■ 



4 Lower bounds 
4.1 Preliminaries 

In this subsection, we develop a framework for proving lower bounds for computing S^{X) 
in the inhomogeneous SIIS model, based on the method of substitution | |SW99| , |ShpUl[ . 
Suppose that over a field F 

r Si 

Sl{X) = Y,l[L,,{X) (12) 

i=i j=i 

where each Lij{X) is a linear form over Xi, . . . , Xn, not necessarily homogeneous. We wish 
to show that r must be large. Following the proof of the Graham-Pollack theorem that 
was sketched in the introduction, we could try to force some of the Lj^'s to zero by setting 
the variables to appropriate field elements. There are two difficulties with this plan. First, 
since the Lj^'s are not necessarily homogeneous, we may not be able to set all of them 
to zero; we can do so if the linear forms have linearly independent homogeneous parts. 
The second difficulty arises from the nature of the underlying field: as remarked in the 
introduction, S^{X) might vanish on non-trivial subspaces of F"^. 

In this subsection, our goal is to first show that if r is small, then S^{X) must be zero 
over a linear subspace of F" of large dimension. Similar observations have been used by 
Shpilka and Wigderson ||SW99| , Lemma 3.3] and Shpilka ||Shp01| , Claim 4.6]. Our second 



goal is to examine linear subspaces of F" over which S^{X) is forced to be zero. We 
derive conditions on such subspaces, and relate them to the existence of a certain family 
of vectors. Later on, we will exploit these equations based on the field in question, and 
derive our lower bounds for r. 

Goal 1: Obtaining the subspace. 
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Lemma 8 // S^{X) can be written in the form of ( |J^ over a field ¥, then there exist 
homogeneous linear forms ii, £2, • • • , 4 in variables Xi, X2, . . . , X^-r such that 

SliX,, X,,..., X^_r, h, £2,..., 4) = (13) 

Proof: We implement the idea discussed at the beginning of Section Given an ex- 
pression of the form ([T^), we collect a maximal consistent set of equations of the form 
Lij{X) = 0, with at most one equation for each i. We write these equations in the form 

AX = b (14) 

where A is an r' x n matrix and b G F*"' for some r' < r. Since (0) has a solution, and the 
rank of A is at most r, there is an affine subspace of solutions F of dimension n — r in F". 
(If the actual solution set is an affine subspace of dimension greater than n — r, then we let 
F be an affine subspace of the solution space of dimension exactly n — r.) We can view this 
set of solutions as follows (see e.g. [|Art91| , Chapter 1]): there are n — r 'free variables,' and 



the values of the remaining r variables are given by (possibly inhomogeneous) linear forms 
in these n — r variables. Since S^{X) is symmetric, we may assume that the n — r 'free 
variables' are Xi, X2, . . . , Xn-r', for i = 1, 2, . . . , r, let ii be the (possibly inhomogeneous) 
linear form in Xi,X2, . . . ,Xn-r that determines the value of Xn-r+i once the values for 
Xi, X2, . . . , Xn-r are fixed. 

Observe that S^iX) is constant over F. To see this, consider the right hand side of 
(|I^). If for some i an Lij participates in ([T^), then that product contributes zero to the 



sum. Otherwise, since the chosen set of equations is maximal, for this i, the homogeneous 
part of each Lij is in the row span of the matrix A. That is, once AX has been fixed to 
b, the homogeneous part, and hence the entire linear form, is fixed. We conclude that 

S'^(Xi, X2, . . . , Xn-r, ^1, -^2, • • • , 4) = constant 

Now comparing the coefficients of monomials of degree two on both sides of the above 
equation, we see that 

Sni^l, ■ ■ ■ , Xn-r, ^1, ^2, ■ ■ ■ , ^r) =0 

where ii is the homogeneous part of ii. ■ 
Goal 2: The nature of the subspace. Our goal now is to understand the alge- 
braic structure of the coefficients that appear in the linear forms ii,i2, . . . ,ir promised 
by Lemma Let ii = Yl^Zi £ijXj,iij € F, and let L be the r x [n — r) matrix (%). 
Let yi,y2, ■ ■ ■ ,yn-r £ F'' be the n — r columns of L. We will obtain conditions on the 
columns by computing the coefficients of monomials X| for 1 < j < n — r, and XjXj for 
l<i<j<n — r.,'m equation (|l^). For X| (1 < j < n — r), we obtain the following 
equation over F. 

r 

^4i+ ^kjik'j = Q l<3<r (15) 

k=l l<k<k'<r 
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For monomials of the form XiXj (1 < i < j < n — r), we obtain the following equation 
over F. 

r r 

^ + J2^^' + Y1 + 5Z ^^^'^^'^ + ^^'^^^^^ = ° l<i<j <n-r (16) 

fc=l fc=l l<fc<A:'<r 

For a positive integer m, let 1^ be the all I's column vector and 0^ be the all O's 
column vector of dimension m. Let Um be the m x m matrix with I's above the diagonal 
and zero elsewhere. Let 3m be the m x m matrix with all I's, and let 1^ be the m x m 
identity matrix. Using this notation, we can rewrite (^) and (|T6D as follows. 

iJy.+yJVrVj = l<j<n-r (17) 
l + l^yi + lJyj + yf{Jr-Ir)yj = 1<i< j<n-r (18) 

If the characteristic of F is not two, we may rewrite ([17D as 

2l'^y, + yJ{Jr-Ir)yj=0 l<J<n-r (19) 

With this, we are now ready to prove lower bounds. We will exploit (0), ([18|) and (|19]) 
(if the characteristic is not 2) to derive lower bounds for various fields. 



4.2 Lower bounds for GF(2) 

Let Z stand for the integers. For y ^ 7/" , let \y\ denote the number of odd components in 
y. For y, y' , let y ■ y' = ^^=1 ymU'm be the dot product of y and y' over Z. 

Lemma 9 Suppose ii, . . . ,ir ore homogeneous linear forms in the variables Xi, . . . , Xn-r 
such that 52 (Xi, . . . , £1, . . . , 4) = over GF{2). Then r > [f J . If n = 3 mod 4, 
then r> [f ] . 

Proof: We use the arguments of Section |4.1| . If there exist homogeneous linear forms 
ii, . . . ,ir over variables Xi, . . . , Xn-r so that S^{Xi, . . . , Xn-r, ■ ■ ■ =0 over GF(2), 
we have, from (p!7D and (0), vectors yj e GF(2)'', 1 < j < n — r such that the following 
equations hold over GF{2) (recall that Jr denotes the r x r all I's matrix, and Ir denotes 
the r X r identity matrix). 

lJy,+yJVry, = l<j<n-r (20) 
1 + l^y, + l^y, + (J, - I,)y, = l<t<j<n-r (21) 

Instead of thinking of the above equations as holding over GF{2), it will help for this proof 
to treat the vectors yj as elements of Z'' and the equations (pOf) and (|2ll) as equivalences 
over the integers mod2. 

By counting the number of odd components (i.e. I's) on the left and right hand side 
of (pOD, we obtain 




= (mod 2) 1 < j < n — r 
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From this it follows that 

\yj\=0oT3 (mod 4) l<j<n-r (22) 

Since yj{ir — ^r)yj = lUil lUjl — Hi ■ Vj over Z, by counting the number of odd components 
(i.e. I's) on both sides of (pT]), we get 

IVil + IVjl + IVil IVjl +yi-yj = ^ (mod 2) l<i<j <n-r 
In other words, 

yi-y, = il + \y,\)il + \y,\) (mod 2) l<i<j<n-r (23) 

Let Wi, . . . ,Ws be the vectors among 7/1, ... , yn-r with \yj\ odd, and let ei, . . . , be the 
remaining t = n — r — s vectors, with \yj\ even. 

Claim If yi,y2,... ,yn-r are not linearly independent over GF(2), then the only depen- 
dency over GF(2) among them is X]fc=i = 0^. Also, in that case, t is odd. 
Proof: Let 

s t 

diWi + ^ (3kek = Or (mod 2) 

i=l fe=l 

In the above equation, we think of Wi, as vectors in Z^, Oj, /^^ as integers, and the equality 
as an equivalence over the integers mod2. We take dot products of the two sides above 
with Wi and conclude, using (|23|) , that ai = mod 2, for 1 < z < s. Similarly, taking 
dot products with e^, we obtain the system of equations {3t — lt)P = Ot mod 2, where 
(3 El} and the kih. component of (3 is If t is even, (Jj — It) is full-rank over GF(2), so 
/3 = Ot mod 2. So the y/s are linearly independent over GF(2), which is a contradiction. 

Now, if the |/j's are not linearly independent, then t must be odd, and the only depen- 
dency among them corresponds to (3 such that (J^ — I^)/? = 0^ mod 2. The only non-trivial 
solution mod2 for this equation is /3 = 1^ mod 2. ■ 

By the claim above, we see that there are at least n — r — 1 linearly independent vectors 
over GF(2) among the y/s. Since the y/s are r-dimensional vectors, we get r > n — r — 1 
i.e. r > [|J . This proves the first part of the lemma. 

To obtain a better bound for r when n = 3 mod 4, we make better use of our equations, 
especially (|2^) , which we have neglected so far. So suppose n = 2r + 1 and n = 3 mod 4. 
We shall derive a contradiction. 

If = 2r + 1, then n — r > r, and since the yj are r-dimensional vectors, yj are not 
linearly independent over GF(2). Then by the claim above, t is odd, X]a;=i = Or mod 2, 
and wi, . . . , Ws, ei, . . . , et-i are linearly independent over GF(2). Since s+t—1 = n—r — 1 = 
r, these vectors form a basis (over GF(2)) of the vector space GF(2)'~; in particular 1^ is 
in their span, that is 

s t-1 

OiiWi + ^ Pkek = Ir (mod 2) 

i=l k=l 
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for some ai,Pk £ ^- Taking dot products with Wi and e^, we conclude (using (|23|)) that 
= 1 mod 2 for 1 < i < s, and {3t-i — = Ot-i mod 2, where /? G and 

the /cth component of /5 is Since t is odd, Jj_i — It-i is full rank over GF(2), and 
P = Ot-i mod 2. Thus 

s 

^Wi = lr (mod 2) (24) 

It is easy to verify that for all integer vectors y 

\y\ = y ■ y (mod 4) (25) 
Using (ID and (|2|), (E!=i ^^^i) " (ELi ^i) = I Ei=i ^^^il = mod 4, that is 

s 

■ w j + 2 ■ Wj = r (mod 4) 

By ( p2D and (^5]) , Wi ■ Wi = \wi\ = 3 mod 4, and by (p3D , ■ Wj = mod 2 for i 7^ j. 
Thus 

s 

^ 3 + ^ = r (mod 4) 

i=l l<*<i<s 

^ 3s = r (mod 4) (26) 

Similarly, by starting with X]fc=i = Or mod 2 and using (^5]) we get that, (X]fc=i ^fc) ' 
(ZlLi Cfc) = I Ylk=i efcl = mod 4, that is 

t 

Cj ■ Cj + 2 Cj ■ = (mod 4) 

i=l ^<i<j<t 

By (p^) and (pSj), Cj ■ Cj = mod 4, and by (|23D, Cj ■ ej = 1 mod 2 for i 7^ j. Thus 

t 

^0+ ^ 2 = (mod 4) 

i=l l<i<j<t 
t(t-l) 

=^ 2 = mod 4 

2 

Since t is odd, we conclude that t = 1 mod 4. But then, using (|26|) , 

n = r + s + t = 3s + s + l = l (mod 4) 

which is a contradiction. 

Since r > [^J holds for all n, we have shown that if = 3 mod 4, then r > j"^] . ■ 
Using Lemmas ^ and |^, we can now prove the following theorem. 

Theorem 6 Any (not necessarily homogeneous) EIIS circuit computing S^{Xi, . . . , Xn) 
over GF{2) requires at least \^ multiplication gates if n = 0,2,3 mod 4, and at least [|J 
multiplication gates if n = 1 mod 4. 
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4.3 Fields of characteristic different from 2 



In this subsection, we give the proofs of our lower bounds for computing S^{X) using 
(not necessarily homogeneous) SIIS arithmetic circuits over various fields of characteristic 
different from 2. Lemma |10| proves an upper bound on the dimension of a subspace over 
which 5*1^ (Xi, . . . , X2k) vanishes. The proof uses Nisan and Wigderson's method of partial 
derivatives. 

Lemma 10 If k ^ in the field ¥ then ^^^.(Xi, . . . , X^+i, £i, . . . , 4-i) 7^ for any k — 1 
homogeneous linear forms ii, . . . , 4-i in the variables Xi, . . . , X^+i over ¥. 



Proof: This lemma is in fact a special case of a more general result due to Shpilka | Shp01|| 



We give a short proof of it here, which is essentially Shpilka's proof restricted to our special 
case. We have the identity 

Siki^ij ■ ■ ■ ^^k+i,h, ■ ■ ■ ,^k-i) = 'S'^+i(Xi, . . . , Xfe+i) + 

(Xi + ... + Xfc+i)(£i + --- + 4-i) + 
5ti(4,...,4-i) 

Assuming for the sake of contradiction that the left hand side of the above equation is 
zero, we get 

5'^+i(Xi, . . . ,Xfc+i) 
= -(Xi + ■ ■ ■ + Xfc+i)(4 + ■ ■ ■ + 4-i) - Sl_,{ii, . 



'^k-i 



We take the first order partial derivatives with respect to Xi, . . . , X^+i of both the sides 
of the above equation. Since 7^ in F, the vector space spanned by the set of first-order 
partial derivatives of S'|_j,]^(Xi, . . . , X^+i) is of dimension k + 1. This follows from the fact 
that the matrix J^+i — I^+i is of full rank if 7^ in F, where J^+i is the {k + 1) x {k + 1) 
all I's matrix and I^+i is the {k + 1) x {k + 1) identity matrix. The vector space spanned 
by the first order partial derivatives of the right hand side of the above equation lies in the 
span of the linear forms (Xi + ■ ■ ■ + X^+i) and ii, . . . , £k~i- Hence its dimension is at most 
k, which results in a contradiction. This proves the lemma. ■ 



Lemma |TT] also proves upper bounds on the dimension of a subspace over which 
^^^(Xi, . . . ,X2k) vanishes, but the proof does not use partial derivatives. 

Lemma 11 Suppose k ^ —1 in the field F and F is not of characteristic 2. Then 
5'|^(Xi, . . . , Xfc+i, ii, . . . , 4-i) 7^ for any k — 1 homogeneous linear forms 4, • • • , 4-i 
in the variables Xi, . . . , X^+i over F. 

Proof: Using the arguments of Section ^?T] (in particular (|TB|) and ([TP|)), we assume (using 
the notation of that section) for the sake of contradiction that there exist vectors yj G 
F^~^, 1 < j < k + 1, such that the following equations hold (note that the characteristic of 
F is not 2). 



{yj,y,) + 2ll_,y, = l<j<k + l 
{yj,yi) + ll_,yj + ll^,yi = -1 l<j<l<k + l 



(27) 



22 



where {v,w) = v'^{Jk-i — lk-i)w is a symmetric bilinear form on vectors in F'^ ^. 
From the above equation, we get 

{y,-yi,yj-yi) = 2 l<j<l<k + l (28) 

We can think of equation (^) as placing k + 1 points with pairwise "distance" a/2 in F'^^^. 
We now show that if 7^ — 1 in F, this is impossible. 

We have, for 1 < j < / < + 1 

2 = {yj - yu Vj -yi) ■■■ using (H) 

= {{vj - yi) - {yi - yi), ivj - yi) - ivi - yi)) 

= {yj - yi,yj - yi) - 2(i/j - yi, yi - yi) + {yi - yi, yi - yi) 
= 2 + 2-2{yj-yi,yi-yi) ...using 



Hence, since 2 7^ in F, 

{y,-yi,yi-yi) = l l<j<l<k + l (29) 
Now define a. k x k matrix A where 

= ivj+i - yi^ yi+i -yi) ^<jJ<k 

Using (pSD and (pOj), we see that the matrix A has 2's on the main diagonal and I's 
in other places. Since A; 7^ —1 in F, A is of full rank. This implies that the vectors 
1/2 — Z/i, 2/3 — 2/1, • • • , yk+i — yi are linearly independent. In fact we have shown that the 
vectors yi, . . . , yu+i are affinely independent. Since these vectors lie in F*^"^, we have arrived 
at a contradiction. Hence the lemma is proved. ■ 
We can now prove the following lemma. This lemma allows us to prove lower bounds 
for computing S'^{X) using (not necessarily homogeneous) SHE arithmetic circuits over F 
when F is not of characteristic 2 and n is even. 

Lemma 12 S'|j;.(Xi, . . . , X^+i, £1, . . . , Ik-i) 7^ for any k — 1 homogeneous linear forms 
ii, . . . , in the variables Xi, . . . , Xk+i over a field ¥, if¥ is not of characteristic 2. 



Proof: Follows from Lemmas and |TT 



We also prove the following lemma. This lemma allows us to prove lower bounds for 
computing S^{X) using (not necessarily homogeneous) SHE arithmetic circuits over F 
when F is not of characteristic 2 and n is odd. 

Lemma 13 Suppose k 7^ 0, ±1 in the field F and ¥ is not of characteristic 2. Then 
S2k+i{Xi, . . . , Xfc+i, ii, . . . ,ik) 7^ for any k homogeneous linear forms ii, . . . ,ik in the 
variables Xi, . . . , Xk+i over ¥. 

Proof: Using the arguments of Section (in particular (|18D and ([T9|)), we assume (using 
the notation of that section) for the sake of contradiction that there exist vectors yj G 
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IF*^, 1 < j < A; + 1, such that the following equations hold (note that the characteristic of F 
is not 2). 

{yj,y,)+2llyj = 1 < j < A; + 1 \ 
{y,,m) + lly, + llm = -1 1<J</<A: + 1/ ^^^^ 

where {v,w) = v'^{Jk — Ik)w is a symmetric bilinear form on vectors in F*^. 

We can similarly show, as in the proof of Lemma 0, that the vectors y2 — Vi^Vs — 
yi, . . . , yk+i — yi are linearly independent (since k ^ —1 and 2 7^ in F). Also 

{yj-yi,yj-yi) = 2 l<j<l<k + l (31) 

Since A; 7^ 1 in F, let us define a vector c G F*^, c = -^^k- Now (J^ — Ifc)c = — 1^ and 
c^{Jk — Ia;)c = -j^. Hence we have, for 1 < j < k + 1 



iVj - c, Vj - c) = {yj, yj) - 2{yj, c) + (c, c) 

k 

= {yj,yj) + '^'^lyj + j—Y 

Using the first equation in (|30D and above equation, we get the following equation 



{y^-c,y,-c) = ^^ l<j<k + l (32) 

Shifting the origin to the vector c and using ( |3TD and (p2D we have (using the same letters 
1 < j < Ac + 1 to denote the new vectors) 

{y,^y,) = ih i<j<A: + i 1 , . 

{yj-yuyj-yi) =2 i<j</<A; + i/ ^ > 

We can think of equations (|33D as placing A; + 1 points of pairwise "distance" \/2 on the 



surface of a sphere of "radius" y in F'^. We now show that if A; 7^ 0, ±1 in F, this is 

impossible. 

Using ( |33[ ) we get, for 1 < j < / < A; + 1 



{yj - yu yj - yi) 

{yj^yj) -"^{yj^yi) + (yhyi) 

"^{yj^yi) 



2k 



k-i 

Since 2 7^ in F, we get 

(%-,2/z) = r^ 1<J</<A; + 1 (34) 
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Using (|3^) and ( |3lD we have, for 1 < j < A; + 1 

fc+l k+l k+l 

1=1 i=l i=l 

= 

Since j/2 — yi, — yi, . . . , yu+i — yi are k linearly independent vectors in F'^, we conclude 
that 

fc+i 

$^2/i = (35) 
1=1 

as only the zero vector is orthogonal to all vectors in F*^ under the bilinear map induced 
by the full rank matrix — 1^ (since 7^ 1 in F, — is of full rank). Using (^3|), ( ^4|) 
and (|35|) and the fact that 2 7^ in F, we get 

fe+i fe+i 

k+l 

j=l ^<j<l<k+l 

2k{k + l) 

k-1 

We have thus come to a contradiction since k ^ 0, ±1 and 2 7^ in F. Hence the lemma 
is proved. ■ 
We can now prove our lower bound result for complex numbers. The proofs of our 
lower bounds for GF{p^), p an odd prime can be found in the appendix. 

Theorem 7 Any (not necessarily homogeneous) SITS circuit computing S^{Xi, . . . , Xn) 
over the field of complex numbers requires at least ["l] multiplication gates. 

Proof: Since S^{Xi, X2, X3) is an irreducible polynomial, any SIIS circuit computing it 
should have at least 2 multiplication gates. For larger values of n, we invoke Lemmas ^, 



12| and [T^ to complete the proof. ■ 
Finally, we show that the n — 1 lower bound of Graham and Pollack also extends to 
inhomogeneous SIIS circuits over rational and real numbers. 

Theorem 8 Any (not necessarily homogeneous) SIIS circuit computing S^{Xi, . . . , Xn) 
over reals / rationals requires at least n — 1 multiplication gates. 
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Proof: As observed in the introduction of this paper 

n 

T^(Xi, . . . = (^XjY - 2S'^(Xi, . . . ,X„) 

Hence, any SIIS circuit computing S'^(Xi, . . . , X„) with less than n — 1 multiphcation 
gates gives us a EIlS circuit computing T^(Xi, . . . with less than n multiplication 
gates. This implies, from the ideas of Section [4.1| , that there are n — 1 homogeneous linear 
forms ^1, . . . in the variable Xi such that T^(Xi,£i, . . . = 0. This is clearly 

impossible over rationals / reals, since the coefficient of will not vanish. ■ 

5 Conclusion and open problems 

In this paper, we have studied the problem of computing the degree two elementary sym- 
metric polynomial in n variables, S'^(X), in the EIIE arithmetic circuit model over various 
fields. For R, Q and C, we obtain exact bounds for all n, and for GF(2) and GF(p^), p 
an odd prime, we obtain exact bounds for infinitely many n. One of the implications of 
this work is an exact bound of [|] for infinitely many n for the 1 mod p cover problem, p 
prime, generalising a result of Graham and Pollack. 

Our work, however, leaves some important questions open. The most immediate one is 
to resolve the remaining gaps between upper and lower bounds for computing S'^{X). This 
would be especially interesting for the odd cover problem, since we know examples of n 
where one requires more than [|] complete bipartite graphs to odd-cover the edges of Kn- 
Another open problem is to prove exact bounds for SHE arithmetic circuits computing the 
degree k elementary symmetric polynomial in n variables, 5'^(X), when k > 2. And finally, 
probably the most important open problem in the field of arithmetic circuits today is to 
prove super polynomial lower bounds for inhomogeneous EIIE arithmetic circuits com- 
puting an explicit polynomial (e.g. permanent, determinant) over fields of characteristic 
zero. 
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Appendix 

A Finite fields of odd characteristic 



A.l Bounds 



Field 




Our B 
Upper Bnds. 
Hom. 


ounds 
Lower Bnds. 
Inhom. 


Previous 
Upper Bnds. 
Hom. 


Bounds 
Lower Bnds. 
Hom. 


GF(p'') 
r even 
p > 3 


n even 
n odd 


[flVn 


fVn 

[fl 3-n 
1^1 Vn 

L 2 J 


f + lVn 


fVn 

[fl 3-n 
If 1 Vn 

L 2 J 


GF(3'') 
r even 


n even 
n odd 


fVn 
[flVn 


fVn 
[fJVn 


f + IVn 
[flVn 


fVn 

[fl 3-n 

L 2 J 


GF(p'') 
r odd 
p = 1 mod 4 


n even 
n odd 


f3°^n 


fVn 

[f 1 3-n 


f + IVn 


fVn 

[fl 3-n 


GF(p'') 
r odd 
p = 3 mod 4 


n even 
n odd 


[f ] 3°°n 


fVn 


n — IVn 
n — IVn 


fVn 



A. 2 Proofs of the upper bounds 

For GF(p''), r even and GF(p^),p = 1 mod 4, r odd, the proof of the upper bound is very 
similar to our upper bound proof for complex numbers. The technical reason behind this 
is that these fields have square roots of —1. Since the fields GF(p''),p = 3 mod 4, r odd 
do not have square roots of —1, we cannot mimic the upper bound arguments for complex 
numbers for these fields. To prove upper bounds for these fields, we use the upper bounds 
for the 1 mod p cover problem. Because of this, the upper bound of for infinitely many 
odd n actually holds only for infinitely many odd n congruent to 1 mod p. For these fields, 
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the lower bound of for odd n in the homogeneous model only holds if n ^ 1 mod p. 
Thus, for these fields, there is a gap of an additive term of 1 between the upper and the 
lower bounds for infinitely many odd n. 
GF{p''), r even, p odd and GF{p''), r odd, p = 1 mod 4 

Theorem 9 Letp be an odd prime. S^{X) can be computed by a homogeneous SHE circuit 
using multiplication gates over GF{p^), r even. Over GF(p^'), r odd, p = 1 mod 4, 
S^{X) can be computed using [l] multiplication gates if n is odd, | multiplication gates 
for infinitely many even n, and f + 1 multiplication gates for all even n. 



Proof: If p = 1 mod 4 then —1 and 2 have square roots in GF{p) (see e.g. ||NZM91| , 



Chapter 3]). Hence using Lemmas^ and |^ over GF(p''), r odd, p = 1 mod 4 S^{X) can be 
computed using multiplication gates if n is odd, and using | multiplication gates for 
even n such that n — 1 has a square root in GF(p''), which holds for infinitely many even 
n. For all even n, S^{X) can be computed using f + 1 multiplication gates by taking a 
circuit with that many gates for S'^_,_^(Xi, . . . , Xn+i), and setting X„+i to 0. Over GF{p^), 
r even every element of GF{p) has a square root (see e.g. |[Art91| , Chapter 13]). Hence 



using Lemmas ^ and ^ again, S'^{X) can be computed using multiplication gates for 
all n. m 

GF{p^), r odd, p = 3 mod 4 

Theorem 10 Letp = 3 mod A be a prime. For infinitely many even and oddn, S'^{X) can 
be computed by a homogeneous SHE circuit using [l] multiplication gates over GF{p^), r 
odd. 

Proof: Such fields do not have a square root of —1. Hence we cannot use either of the 
Lemmas ^ and ^ To get upper bounds of [|] for infinitely many even and odd n, we have 
to make use of the fact that upper bounds for the 1 mod p cover problem (Theorem ^) give 
us upper bounds for computing S'^{X) in the homogeneous circuit model. ■ 



A. 3 Proofs of the lower bounds 

The proof of the lower bound is similar to the lower bound proof for complex numbers, 
though, because of technical difficulties, the results are not as tight for some values of n, 
as they were in the case of complex numbers. 

Theorem 11 Any (not necessarily homogeneous) SHE circuit computing S^{Xi, . . . 
over GF{p'^) where p is an odd prime, requires at least 

1. [l] multiplication gates if n is even 

2. [l] multiplication gates if n is odd and n ^ ±1, 3 mod p 

3. [|J multiplication gates if n is odd and n = ±1, 3 mod p 
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Thus, as long as p is an odd prime, we have a lower bound of [^J for all n. If p > 3, we 
have a j"^] lower bound for all even and infinitely many odd n. 

Proof: The lower bounds in parts |^ and |^ follow from Lemmas |1^ and |I3|. Suppose n is 
odd. Since a SIIS circuit computing S'^{Xi, . . . , X„) also gives us a SIIS circuit computing 
S'^_i{Xi, . . . for which we have a lower bound of we get the lower bound in 

part 1^. ■ 
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